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Abstract 

Measuring the average information that is necessary to describe 
the behaviour of a dynamical system leads to a generalization of the 
Kolmogorov-Sinai entropy. This is particularly interesting when the 
system has null entropy and the information increases less than linearly 
with respect to time. We consider two classes of maps of the interval 
with an indifferent fixed point at the origin and an infinite natural 
invariant measure. We calculate that the average information that is 
necessary to describe the behaviour of its orbits increases with time 
n approximately as n", where a < 1 depends only on the asymptotic 
behaviour of the map near the origin. 

1 Introduction 

The complexity and unpredictability of a chaotic system has been measured 
using many different indicators. Among all one of the most important is 
the Kolmogorov-Sinai (K-S) entropy. Being based on the Shannon's notion 
of information, it is an average measure of the quantity of information that 
is necessary to describe each step of the behaviour of the system (with an 
arbitrary accuracy given by the choice of a partition). 

More recently other notions of information content, such as the Kolmo- 
gorov-Chaitin Algorithmic Information Content, have been applied to dy- 
namical systems. These notions are pointwise and allow to consider the 
complexity of the behaviour of a single orbit. Hence it is possible to define 
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the information I{x, n, Z) contained in n steps of the orbit of a point x with 
respect to a partition Z of the phase space. This can be done by associat- 
ing to the orbit of x the symbohc orbit with respect to Z and considering 
the information content of this string (see Section ^ . The average of this 
pointwise information over an invariant measure is strictly related to the 
K-S entropy /i^(T, Z) of the measure fi relative to the partition Z. Indeed 
for a "typical" point x it holds I{x,n,Z) ~ n hf^{T,Z) (see Theorem \2.'A^ . 
When the entropy is null the previous relation becomes I{x,n,Z) = o{n). 
The many possible different sublinear asymptotic behaviours of I{x, n, Z) 
correspond to different kinds of "weakly" chaotic dynamics. The impor- 
tance of this indicator of weak chaos is also confirmed by the relations that 
have been proved, even in the null entropy case, between the behaviour 
of the information and many important features of the dynamics, such as 
sensitivity to initial conditions, dimensions, recurrence f [5] . pi] . [7] . . [TB] 1 
and global topological complexity indicators (^2, see also for relations 
between the topological complexity and other physically important features 
of dynamics). 

A class of systems which have a sublinear increase of the information 
are the systems with an infinite invariant measure (see Theorem 12. 4() . An 
important subclass of these consists of maps with an indifferent fixed point, 
being an important example the map on the interval [0, 1] given by 



In the above family of maps the origin is a neutrally unstable fixed point, 
hence an orbit that is sent near the origin can be trapped near the origin 
for long times. The resulting behaviour is an alternation of chaotic (when 
the orbit stays far from the origin the map is similar to the baker's map) 
and regular (when the orbit is trapped near the origin) phases. The ex- 
pected trapping times can be modulated by varying z. For these reasons 
this map was introduced in the physical literature in as a model of inter- 
mittent turbulent behaviour in fluid dynamics, and the particular statistical 
properties of the orbits of these maps were used in different fields to model 
intermittent phenomena (see for example ,.3J. 

From the information point of view these maps exhibit a behaviour that 
is between the fully chaotic (positive entropy) and the regular one (the 
dynamics is predictable, the information needed to describe it increases with 
time n at most as log(n)). This was first discovered in ^3] in a piecewise 
linear example (see Section^. Their seminal, short paper however does 
not present a complete mathematical proof of this fact (a lower bound, like 




for z > 2 
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Theorem 13.81 is not proved) . Some further study was made in ^5] (where 
the lower bound was proved under some assumption on z) and in 

This paper considers both and piecewise hnear (PL) classes of interval 
maps with an indifferent fixed point. The case is studied using techniques 
that are different from the techniques used in the previous literature. 

The main result of this paper implies that, in mean with respect to any 
absolutely continuous probability measure the information of the "Manne- 
ville-Pomeau like" (see Definition 13.1(1 class of maps, for which equation 
is an example, behaves for z > 2 like 

E[I{x,n,Z)] ~ 

that is as a power law with exponent less than 1 (see Theorem 13.9(1 . This 
shows in particular that the behaviour of the information content for these 
maps depends only on the local behaviour of the map near the neutrally un- 
stable fixed point at the origin. Some results about the pointwise behaviour 
of I{x,n,Z) are also given (see Proposition 13 . 11 (1 . 

Moreover we study a class of piecewise linear maps, extending the re- 
sults of ^1], finding in particular different behaviours for the mean of the 
information content (see Section^. 

All our results are based on the definitions of Section |21 where we intro- 
duce in an informal way the Algorithmic Information Content of a string 
and the few related facts about algorithmic information theory that we need 
in the following. Then using these concepts we define the local and global 
chaos indexes, which measure the local and average power law behaviour of 
the information I{x, n, Z) (roughly speaking when I{x, n, Z) ~ then the 
index is a). The invariance properties of these indexes and the results on the 
Manneville-Pomeau maps imply, as a simple corollary, that two Manneville- 
Pomeau maps with different parameter z cannot be absolutely continuously 
conjugate (Corollarv 13.10(1 . 

2 Information measures and chaotic 
dynamical systems 

The method we use to study a chaotic dynamical system is based on the 
idea of a measure of the information contained in the orbits of the system. 

Let ^ be a finite alphabet and let be the set of all strings of length n 
written with letters from A. Then by A* we denote the set of finite strings 
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of any length, that is 

oo 

A* =\JA'' 

n=0 

Given a string s (z A*, the intuitive idea of information contained in s is the 
length of the smallest binary message from which it is possible to reconstruct 
s. Thus, formally, the information / is a function / : >1* ^ N. 

One of the most important measures for the information content is the 
Algorithmic Information Content (AIC). In order to define it, it is necessary 
to define the notion of partial recursive function. We limit ourselves to 
give an intuitive idea which is very close to the formal definition. We can 
consider a partial recursive function as a computer C which takes a program 
p (namely a binary string) as an input, performs some computations, and 
gives a string s = C(p), written on the given alphabet A, as an output. The 
AIC of a string s is defined as the shortest binary program p which gives s 
as its output, namely 

AIC{s, C) = mm{\p\ : C{p) = s} (2) 

where | • | denotes the binary length of the program p. Up to now the Algo- 
rithmic Information Content depends on C, but there is a class of computing 
machines that allows a definition of information content independent on the 
particular computer up to a constant. We require that our computer is a 
universal computing machine. Roughly speaking, a computing machine is 
called universal if it can simulate any other machine if appropriately pro- 
grammed. That is, C is universal if for each other computer D there is 
a program pcD such that for each program p it holds D{p) = C{pcDP)- 
In particular the computers we use every day are universal computing ma- 
chines, provided that we assume that they have virtually infinite memory. 
For a precise definition see for example JHl or We have the following 
theorem 

Theorem 2.1 ( |17| ). If C and C are universal computing machines then 

\AIC{s,C) - AIC{s,C')\ <K{C,C') 
where K {C,C') is a constant which depends only on C and C . 

This theorem implies that the information content AIC of s with respect 
to C depends only on s up to a fixed constant, then its asymptotic behaviour 
does not depend on the choice of C. For this reason from now on we will 
write AIC{s) instead of AIC{s, C). 
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The shortest program which gives a string as its output is a sort of en- 
coding of the string, and the information which is necessary to reconstruct 
the string is contained in the program. From this point of view the computer 
can also be seen as a decoder. Unfortunately the coding procedure associ- 
ated to the Algorithmic Information Content cannot be performed by any 
algorithm. This is a very deep statement and, in some sense, it is equiva- 
lent to the Turing halting problem or to the Godel incompleteness theorem. 
Then the Algorithmic Information Content is a function not computable by 
any algorithm. Hence in computations one tries to approximate from above 
the AIC of a string by means of some algorithm. This leads to consider the 
theory of compression algorithms, algorithms that encode an original string 
s G v4* into a compressed version of it M(s) G {0, 1}* in a reversible way 
(i.e., there is an other algorithm that is able to recover the original string 
from the coded string). Using a compression algorithm M one defines the 
information content of the string s with respect to the encoding procedure 
M as Im{s) = \M{s)\, where | • | denotes the binary length of M(s). We 
remark that the Algorithmic Information Content of a string is up to a con- 
stant less than or equal to the information content as it is computed by 
some compression algorithm. That is, for each compression algorithm M 
there is a constant Cm such that for each s it holds Im{s) > AIC{s) + Cm- 
This is because each universal computing machine can be programmed also 
to perform any coding-decoding technique, and the length of this program 
represents Cm- 

To study a chaotic dynamical system we have to consider the asymptotic 
behaviour of its orbits, hence if we want to consider in some sense the infor- 
mation contained in the orbits of the system, we have to deal with infinite 
strings. Then let 17 := denote the set of infinite strings uj with letters 
from A- To study the information contained in a infinite string lu, we study 
what is the asymptotic behaviour of the information contained in the first n 
symbols of a; as n increases. Hence we study the asymptotic behaviour of the 
function AIC{u),n) := AIC{lo'^) as n increases, where oj" = (ljq, . . . ,ujn-i) 
is the string given by the first n symbols of cu. By the methods of symbolic 
dynamics we will associate an infinite string to an orbit and then the above 
idea will be applied to dynamical systems. 

2.1 Application to dynamical systems 

Let (X, B, T) be a dynamical system. X is assumed to be a compact metric 
space, B is the Borel a-algebra, and T is a ,B-measurable map from X to 
itself. Let fi he a T-invariant measure on {X, B) . We do not suppose that 
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< oo, but we always assume /i to be fT-finite and conservative"^. 
Let Z = {/q, • • • iIn-i} be a finite measurable partition of X, and let 
A = {0, . . . , — 1} be the associated finite alphabet. Then the symbolic 
representation of the system (X, T, /i) is given by the function ipz '■ X 
= ^ associating to each point a symbolic orbit with respect to Z, defined 
by 

Vz{x) =u; ^ r{x) G V i G N (3) 

The image (pz{X) is a subset of Q. which is invariant under the usual shift 
map r on 17. The function 93^ induces on (pz{X) a measure corresponding 
to jjL. Of course similar symbolic representations can also be defined for 
countable partitions (with a countable symbolic alphabet). 

At this point it is possible to apply the notion of information to the 
orbits of the system. We obtain quantities dependent on a given partition 
Z oi X. The following definition and the following theorem, given in [S], 
shows the relation between AIC and entropy. 

Definition 2.2. The information content AIC{x,n, Z) of n steps of the 
orbit of X with respect to Z is defined as AIC{x,n, Z) = AIC{{ipz{x))^). 
Analogously, the complexity K{x,Z) of a point x (z X with respect to Z is 
given by 

r AIC{x,n,Z) 
A (x, z) = limsup . (4) 

n— >oo ri 

The complexity of a sequence is related to the Shannon entropy of the 
information source that has produced the sequence. Hence in the theory of 
dynamical systems it is possible to relate the complexity to the Kolmogorov- 
Sinai entropy of the system. The following theorem holds 

Theorem 2.3 ([5], [24]). Let {X,T) be a dynamical system and fi a T- 
invariant probability measure on X . Given a finite measurable partition Z 
of X , it holds 

I K{x,Z) df,{x) = h^{T,Z) 
Jx 

where h^{T,Z) denotes the Kolmogorov- Sinai entropy of the system relative 
to the partition Z. If the dynamical system {X,T,fi) is ergodic then for 
fi-almost all X ^ X 

K{x,Z)=limmf^^^^^^^^ = hJT,Z) (5) 

n^oo n 



system is conservative if the set of wandering points has zero measure (see 0). 
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In systems with an infinite measure we have a behaviour of the informa- 
tion that is similar to zero entropy systems, indeed the following holds. 



Theorem 2.4 (|B]). Let {X,T) be a dynamical system and n a T -invariant 
infinite ergodic measure. Given a finite measurable partition Z of X, for 
fi-almost all X ^ X it holds K{x, Z) = 0. 

These theorems tell us what we can expect for the asymptotic behaviour 
of the information content of a typical orbit of an ergodic dynamical sys- 
tem. If the system has an invariant probability measure /x with positive 
Kolmogorov-Sinai entropy relative to a partition Z, then for //-almost all 
X e X it holds^ 

AIC{x,n,Z) ^nh^,{T,Z) (6) 

If instead the ergodic measure /t has null Kolmogorov-Sinai entropy or it is 
an infinite measure, then for //-almost all x G X 

AIC{x,n,Z) = o{n) (7) 

for any finite partition Z. In this second situation we introduce the notions 
of local and global chaos indexes to classify dynamical systems according to 
the asymptotic behaviour of AIC{x, n, Z). 

Let {X, T) be a dynamical system and /t a T-invariant measure. Let v 
be a probability measure on X equivalent to /i (each one is absolutely con- 
tinuous with respect to the other). We refer to as a "reference measure". 
Of course when /i is a probability measure, we can set v = fi. Let Z he a 
finite partition of X. 

Definition 2.5. The upper chaos index q(T, Z, v) with respect to Z is given 
by 

g(r,Z,i/) =inf((/G (0,1) / limsup l ^IM^lZ^l^ di/(x) = o| = 

I- n~*oo Jx 

r / N / , f AIC(x,n,Z) , , , 1 

= sup <qG{0,l) I hmsup / dv[uj) = oo > 

n^oo Jx n'i ) 

In the same way the lower chaos index q{T, Z, u) with respect to Z is defined 
using the inferior limit instead of the superior limit. 



^Notations: Here and in the sequel, for two sequences a„ and bn we shall write 
a-n ~ bn if the quotient an/bn tends to unity as n — > oo. Moreover, the notation a„ ~ b„ 
means that an/bn — 0(1) as well as bn/a„ — 0(1) for n ^ oo. Moreover we shall write 
a„ ^ bn if an = 0(6„). 
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We remark that in principle the chaos index may depend on the choice 
of u. In principle, even if we consider equivalent measures, the index may 
change. However we will see that in the class of map we are interested 
to study this does not happen. Moreover we remark that in the examples 
we study there is a natural choice of the reference measure, the Lebesgue 
measure. 

We also define the upper and lower local chaos indexes. 
Definition 2.6. The upper local chaos index q{T, x, Z) is defined as 

g(r,x,Z) =inf fgG (0,1) / limsup -4/C(x,n,Z) ^ q1 

I n~>oo n1 ) 

r / N / , AIC(x,n,Z) 1 
= sup < g G (0, 1) / limsup = oo > 

n— >oo n'^ J 

In the same way the lower local chaos index q{T,x,Z) is defined using the 
inferior limit instead of the superior limit. 

Theorem 2.7 (@). Let fi be ergodic and invariant for the dynamical system 
{X, T) and let v he a reference measure. For any finite partition Z of X, 
the local indexes are a. e. -constant, that is for jjL-almost all x ^ X it holds 
q{T, x, Z) = q{T, Z) and q{T, x, Z) = q{T, Z) . Moreover 

q{T,Z) <q{T,Z,u) <q{T,Z,v) 

Now we want to get rid of the dependence on the partition Z and define 
an indicator that is independent on the partition. We will state a definition 
for maps over the interval. Further generalizations are possible (see @|) but 
for the sake of simplicity here we will restrict to interval maps. 

To avoid pathologies coming from very complicated partitions (see the 
"negative results" in we will consider a class of admissible partitions and 
take the supremum over this class. 

Definition 2.8. A partition Z = {/q, of [0, 1] is called admissible 

if it is made of a finite set of intervals, i.e. each /j is an interval. The upper 
and lower global weak chaos indexes of ([0, 1], T, v) are defined by 

q{T, v) = sup g(r, Z, u) 

ZG adm. part. 

q{T, v) = sup q{T, Z, v) 

adm. part. 
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What we obtained is a weak chaos index for maps of the interval that is in 
general invariant for a bi-Lipschitz conjugacy. Let us consider the Lebesgue 
measure m on the unit interval. 

Theorem 2.9. If {[0,1], T) and ([0,1], T') are conjugated by a bi-Lipschitz 
homeomorphism ir, then q{T,m) =q{T',m),q(T,m) = q(T',m). 

Proof. It is clear that a homeomorphism sends an admissible partition Z 
to an admissible partition it{Z). We have that 

r AICM.).nMZ)) ^ ^ r AICi.,n,Z) 

where f{x) € L°°[0, 1] and then we can estimate one index in function of 
the other. □ 



3 The "Manneville-Pomeau like" maps 

We apply our techniques, based on the asymptotic behaviour of the infor- 
mation content of symbolic orbits, to a family of interval differentiable maps 
T : [0, 1] — > [0, 1] with an indifferent fixed point. 

Definition 3.1. We say that a map T : [0,1] [0,1] is a Manneville- 
Pomeau map (MP map) with exponent z if it satisfies the following condi- 
tions: 

1. there is c G (0, 1) such that, if Iq = [0, c] and Ii = (c, 1], then T\^^ 
and T|^^ extend to diffeomorphisms, r(/o) = [0, 1], T{Ii) = (0, 1] 
and r(0) = 0; 

2. there is A > 1 such that T' > A on /i, whereas T' > 1 on (0,c] and 
r'(0) = 1; 

3. the map T has the following behaviour when x — > 0"*" 

T(x) = X + rx^ + o(x^) 
for some constant r > and z > 1 (see left part of Figure^. 

This family of maps is well known and many statistical (the decay of 
correlations, the central limit theorem and the phenomenon of phase tran- 
sitions) and ergodic (exactness, rational ergodicity, mixing and the return 
time sequences) properties have been deeply analyzed. Most of these studies 
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are made for z < 2, on the contrary we are mostly interested in the case 
z>2. 

For z G (1,2) there is a unique absolutely continuous (with respect to 
Lebesgue measure) probability measure that is T-invariant, moreover /x is 
a Sinai-Ruelle-Bowen measure, it is exact and its Kolmogorov-Sinai entropy 
satisfies ^ 

V(r) = [ log|T'(x)| dfiix)>0 
Jo 

From the statistical point of view, it is known that some changes happen 
when z crosses the value z = |. However from our point of view these 
changes are not relevant. 

Applying Theorem 12.31 and the consequent equation © we obtain that 
if T is a Manneville-Pomeau map with z £ (1,2), and Z is the generat- 
ing partition Z = {/o,/i}, then for the absolutely continuous T-invariant 
probability measure /i it holds 

AIC{x,n,Z) ^nh^{T) 

for ;U-almost all x G [0, 1] . 

Much more delicate is to study the case z >2. Indeed for these values 
of the parameter the only absolutely continuous T-invariant measure ^ is 
infinite. Hence in this case we obtain from Theorem 12.41 and equation ((Jj) 
that AIC{x,n, Z) = o{n) for /u-almost all x E [0, 1], for any finite partition 
Z. To classify these maps we study the behaviour of the chaos indexes 
introduced in Sectional 

The ergodic properties of the infinite measure fi for MP maps with z > 2 
have been studied in and |2J, applying the theory of infinite ergodic 
measures (see ^). In particular the measure fx is shown to be exact and 
rationally ergodic, with estimates for the return time sequences. Putting 
together the results of [211 and the Darling-Kac Theorem ([l]) we obtain 

Theorem 3.2 (Aaronson-Darling-Kac-Thaler). LetT be a Manneville- 
Pomeau map with z > 2 and /i the infinite absolutely continuous T-invariant 
measure. Then for all Borel measurable B C [0, 1] with ^{B) < oo it holds 

^ n—l 

where the convergence is in distribution with respect to all absolutely contin- 
uous Borel probability measures on [0,1], is a positive random variable 
distributed according to the normalized Mittag-Lejfler law of order a and 
a = ^-r. Moreover it holds 
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1 

• a„ ~ n^-i if z > 2. 

The statistical distribution of the frequencies of visits to subsets of [0, 1] 
is the fundamental tool to obtain the behaviour of the AIC of orbits of the 
system. 

Our plan is the following: 

(i) to consider a symbolic representation of the system induced by the 
choice of a partition; 

(ii) to estimate the information content of the orbits using a particular 
encoding as a compression algorithm; 

(iii) to show that this information content has the same average asymptotic 
behaviour as the Algorithmic Information Content. 

To obtain a symbolic representation of the system we will consider a 
finite admissible partition (see Definition 12.8(1 . First we will consider the 
case of a partition made of two intervals Iq = [0, c] and Ii = (c, 1], then we 
will show that the general case is similar. In this first particular case, the 
alphabet associated to the partition Z is A = {0, 1}. 

Let us consider a MP map. As said before the presence of the indifferent 
fixed point at the origin implies that a typical orbit will spend much time 
near the origin, since it moves away from it very slowly, and will spend the 
rest of time around in the interval. Then at some time it will come again 
close to the origin and again stay near the origin a lot of time. This repeats 
over and over again. This fact implies that a typical symbolic orbit will have 
a lot of symbols equal to "0" and some equal to "1". Moreover being the 
derivative of the map bounded from 1 in Ii , the dynamics in this interval is 
"fully" chaotic, and this implies a sort of renewal process when the orbit of 
the point is in Ii (see Section 0}. The results we will see are in some sense 
reminiscent of the theory of renewal processes, but this theory fails for MP 
maps, since they are not isomorphic to a Markov chain. 

We now introduce the encoding we use to estimate the information. A 
typical sequence uj = (pz (x) G {0, 1}^ win look like^ 

to = (000100000000110010000000001101 . . . ) 

^This symbolic representation is well defined for m-a.e. point x £ [0, 1] (analogously 
to the case of the dyadic numbers for the Bernoulli shift). 
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so it is possible to compress its first 30 symbols in the following string 

= (3802901) (8) 

where we have just written how many "0"s there are between two consecutive 
"l"s. Since the number of consecutive zeros can be as high as we want, the 
string s is a string with digits coming from an infinite alphabet (each digit is 
a natural number). Since we want to deal with strings coming from a finite 
alphabet we codify s into a binary string s' , simply using the standard binary 
representation of natural numbers and writing it with the usual prefix-code 
(see below for an example). In this way a number n G N is encoded by a 
binary string (ao, oi, . . . , am) such that 

m 

n = 2""+! - 1 + X] "i^^ 
i=o 

where m + 1 = [log2(ra + 1)J (denoting [-J the inferior integral part of a 
number), and this binary string is written using the prefix-code given by 

n = (l'"+\0,ao,...,a^) 

where 1"^+^ denotes the symbol "1" repeated m + 1 times. In this way, 
leaving unchanged the symbols "0", we obtain for our example 

s'(w^O) = (11000 1110001 101 1110010 100) 

Hence s'(w") is an encoding of the string u)'^ (see Section |21). 

The information function / associated to this compression is given by 

s(a;")|-l 

/,,(a;") = |.V")l= E 2 Llog2(l + s(^")i) J + 1 (9) 

j=0 

where | • | denotes the length of the string. 

Let A''„ : n — > N be the sequence of functions defined by 

A^n(w) = #{i I / 0, i = 0,...,n-l} (10) 

that is the number of passages of the orbit outside the interval /q in the first 
n steps. Then it is easy to realize that in the case of a partition made by 
two intervals Nn{co) = |s(w")|. In this case we now prove a stronger relation 
between Ig/^uj'^) and Nn{uj). 
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Lemma 3.3. For any sequence u G {0, 1}^ it holds 

( Tl 

Nnico) + 2 log2(n - Nnicj) + 1) < /..(w") < Nnico) + 2 Nnicj) log^ 



up to an additive constant given by the possibilities coq = 1 and uJn-i = 0, 
and by the presence of the inferior integral part in the definition of Isi{uj^). 

Proof. It is enough to prove the lemma for = and = 1. Otherwise 
simply add a constant. 

In general Nn = n — h, for some h < n. The compression of such 
strings is then A^^-symbols long. Moreover the compression is such that 
'^f=o^ s(a;")j = h. We now want to find the maximum and the minimum 
of the function 

Nn-l 

^ 2 log2(l + s(a;-),) 

j=0 

with the condition X)i=o~ = ^- The maximum is attained for equal 

s{uj'")j 7^ 0, and the minimum for all the s{u>"')j = but one which is 
equal to h. Then the maximum is given by s{uj'")j = for all j, and the 

information content is given by Yl^=o~^ 1 + 2 log2 ^1 + = + 

2 Nn log2 (^w'^ ' minimum is given by (n— /i — l) + l+2 log2(/i+l) = 

Nn + 2 log2(n — Nn + 1). Hence the lemma is proved. □ 

Let us see what can be done when we have some general admissible 
partition made of a finite number of intervals. Let Z = {Iq, . . . , In-i} be 
such a partition and let A be the associated finite alphabet. In this case we 
assume A to be made of the symbol "0" for the interval Iq, and of letters 
(or any other kind of symbols different from natural numbers) for the other 
intervals. 

We slightly modify the previous coding procedure as follows. We have 
strings u;" G A^, and define s(a;") = {xi,X2, ■ ■ ■ ,Xm), where € N U 
In the sense that we codify as numbers the occurrences of the symbol "0" 
as before, in a way that if at place i there are consecutive "0"s we write 
the number n^. The other symbols are left unchanged. For example, if 
A = {0, A, B} and u;" = (00^55000^) then s(u;") = {2ABB3A). Then we 
define s' as before, by the standard binary encoding of the natural numbers, 
obtaining a string s' written in the alphabet {0, 1,A,B}. In the previous 
example, we obtain s'(a;") = (101 ABB 11000 A). 
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Then we can easily estimate the information function /(w") in this case, 
by noting that the only difference with the previous case of a partition with 
only two intervals is that now when the symbol in is different from "0" we 
have to explicitly specify it, so that in the symbols "0" are replaced 

by the explicit strings, that is "ABB" and "A" in our example. Since there 
are Nn{uj) such symbols different from "0" or "1" in s'{uj'^), we need at most 
Nn{uj)log2{#A — 1) bits more than in the previous case with a partition 
with only two intervals. Note that in the previous case log2(#^ — 1) = 0, 
hence this new term vanishes. We can now state the result 

Lemma 3.4. Let G A" and s' be the encoding as above, then it holds 

where ^A is the cardinality of A. 

This lemma implies that the behaviour of the information content is 
given by the asymptotic behaviour of the functions N^. To estimate the 
behaviour of Nn first of all notice that if x is a point in [0, 1] such that 
^z{x) = uj, then 

n-l 
j=0 

Then we can apply Theorem 13.21 to the sequence with respect to any 
measure v on Q. induced by an absolutely continuous probability measure 
on [0, 1] . This gives the estimates 

r z=2; 
E,KH]~ (11) 
[ n^-i , z > 2. 

obtained by the asymptotic behaviour of the sequence an in Theorem 
where IE,y[-] denotes the mean with respect to the measure v. By the above 
estimates we have 

Proposition 3.5. Let T he a Manneville-Pomeau map with parameter z > 
2. Let Z be an admissible finite partition. Then for any probability measure 
V on Vi induced by an absolutely continuous probability measure on [0, 1] 
through the symbolic representation ipz, it holds 

¥.^[AIC{u'')]<¥.^[I{uj'')]< n, z=2 
E^[^/C7(a;")] < E^[/(w")] < log(n), z > 2. 
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Proposition 13.51 gives an estimate from above for the asymptotic be- 
haviour of Ki^[AIC{uj'^)]. Now we want to calculate a lower estimate. For 
this we consider a map that is derived by the MP map (it is an induced 
map) and which gives a symbolic dynamics that is similar to the compressed 
string s{uj'"'). Proving that such a map has positive entropy we prove (using 
Theorem I2.3|l that no further drastic compression is possible. 

Let us consider again the partition Z = {[0, c], (c, 1]}, we will give a 
lower estimate to q{T, Z, v). The induced version of a MP map is obtained 
studying the passages through Ii. For any x G [0, 1] let t(x) be the time of 
the first passage through Ii, that is 

t{x) = 1 + min {n > [ r"(x) G h} (12) 

The level sets of the function r(x) are a partition of (0, 1] into intervals 
{An)n>i defined as 

An = {xe [0, 1] I r(x) = n} (13) 

Using t{x) we define the induced map G : [0, 1] — > [0, 1] by 

G(x) =T"(^)(x) (14) 

hence GUA^) = T'^{x) and G(^„) = (0, 1], finally we define G(0) = (see 
right part of Figure . 




Figure 1: An example of the graph of an MP map and its induced map. 

By the definition of the induced map, we have the following proposition. 

Proposition 3.6. Let T he a Manneville-Pomeau map and G its induced 
version on Ii. Let Z be the finite partition Z = {Iq,Ii} = {[0, c], (c, 1]} 
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and P he the countable partition of [0, 1] into the intervals (vln)n>0; with 
Aq = {[c, 1]} and An for n > 1 defined as in equation Then for a point 

X it holds ^z{x) = (jj if and only if (pp{x) = s{lo)^, where ipp denotes the 
symbolic representation of the induced map G for the partition P. 

The entropy of the induced map is positive. This is obtained putting 
together the results of Section 10 in ^15j and Theorem 22 in j23j . 

Theorem 3.7 (Isola- Walters). Let T be a Manneville-Pomeau map of 
parameter z and G be its induced version. Then there exists an absolutely 
continuous G-invariant probability measure p on [0,1] such that: (i) p is 

exact for G; (ii) p{An) ~ n ^-i, hence the entropy of the partition P 
respect to p is finite; (Hi) oo > hp{G) = log dp{x) > 0. 

Proposition 3.8. Let T be a Manneville-Pomeau map with exponent z > 
2 and let Z be the finite partition {[0, c], (c, 1]}. Then using as reference 
measure any absolutely continuous probability measure v on [0,1], it holds 
for the lower global weak chaos index 

f 1, z=2 
q{T,u)>q{T,Z,u)> { 

Proof. The inequality q{T, u) > q{T, Z, u) follows trivially by definition. 
By Proposition 13.61 we have that if is a symbolic orbit of x with respect 
to Z then a symbolic orbit of the induced map G with respect to P is s{uj^) 
and |s(u;"')| = Nn{uj). Given a string s = {siS2.--Sm) in N* (like s{u!"')) 
let us consider the string trunck{s) = {min{k, si)min{k, S2)---min{k, Sn)) 
where each digit Si in replaced by min{k, Si). Up to a constant, for each 
k ALC{uj'^) > ALC (trunck{s{u:^)) because the string trunck{s{u:'^)) can be 
obtained easily from by an algorithm. 

We know that the entropy of the induced map is finite and positive, then, 
since the infinite partition P = {Aq, Ai...} is generating, its entropy hp{G, P) 
is finite and positive (Theorem 13.71 (iii)^. then there is a partition of the 
form P^ = {Ao,...,Ak,Ui>kAi} such that hp{G,P) > hp{G,Pl) > 0. This is 
because for each absolutely continuous measure the sequence of partitions 
P^ converges to P in the Rokhlin metric (and the entropy is continuous with 
respect to change of partition in this metric). 

^By the definition of a compression algorithm, s{lo) makes sense only if is a finite 
string, hence this equation has to be intended valid for any finite substring a;" of the 
sequence lu. 
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We remark that trunck{s{uj"')) is the symbohc orbit of x for the induced 
map, with respect to the partition Pj^ and the length of this string is Nn{uj). 
Then by equation © of Theorem 12.31 and by Theorem 13.21 we have that 
given any sequence of positive numbers such that = o{an), where 

{log{n) _ _ 
J , and given any strictly positive constants n,C,e such 

n~, z>2 

that h < hp{G, P^), there exists an integer n such that for all n > n it holds 
p{S{n)) > 1 — e, where 

S{n) = {uj / A/C7(w") > AIC{trunck{s{uj'^))) > /iiV„(w) ; Nn{uj) > Cbn} 

Hence, being p absolutely continuous, for any absolutely continuous prob- 
ability measure i' and for all 5 > there exists a n (different from above) 
such that for each n > n 

^^^^'^"^ du > hC u{S{n)) > hC{l - 6) 
n On 

where /i, C are as above. Hence for all sequences 6„ such that 6„ = o(a„) it 
holds 

liminf / — ^ dv = oo 

K 



n^oo 

hence the thesis follows from the definition of On . □ 



We are finally ready to prove the main result of the paper. 

Theorem 3.9. // is an absolutely continuous probability measure, the 
global weak chaos indexes of a MP map with exponent z >2 are given by 



q{T,u)=qiT,u) 



1, z=2 

Proof. From Proposition 13.51 we have the upper estimate 



f 1, z=2 

for each admissible partition. Moreover from Proposition 13.81 we have the 
lower estimate for g(T, i^). □ 

It is well known that any two MP maps are topologically conjugated, 
the following shows that this conjugacy cannot be absolutely continuous if 
the exponents are different. 
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Corollary 3.10. If and T^/ are MP maps with different exponents z ^ z' 
then there are not absolutely continuous conjugacies between and T^'. 



Proof. As said before an homeomorphism sends an admissible partition Z 
to an admissible partition vr(Z). Considering the Lebesgue measure dx, we 
have that 

AIC(7r(x),n,7r(Z)) , f AIC{x,n,Z) 
ax = -Kidx) 

[0,1] 7[o,i] rii 

where ■K{dx) is absolutely continuous. By Theorem 13.91 the global chaos 
index of the MP maps is the same for each absolutely continuous reference 
measure. By this and the above equation the chaos index of the systems 
([0, l],Tz,dx), ([0, l],Tz, Tr{dx)) and ([0, 1], Tj;/ , dx) should be the same. Since 
the chaos index depends only on z, and z ^ z' this leads to a contradiction. 

□ 

We now conclude our exposition of results about the asymptotic be- 
haviour of the Algorithmic Information Content of the MP maps with a 
result about the local behaviour. From Theorem 13.21 we can deduce that 
for almost each symbolic orbit u; of a MP map with respect to the partition 
Z = {[0, c], (c, 1]} the following relations hold 

limsup > for z > 2, (15) 

n— >oo Tl''-^ 

limsup > for z = 2. (16) 

n^oo nlog(n) 

Hence applying the same techniques of the proof of Proposition 13.81 to 
the upper local chaos index, and recalling Theorem 12 . 71 we have 

Proposition 3.11. If Z = {[0, c], (c, 1]} is the generating partition with two 
intervals of a MP map, then for Lebesgue almost each x € [0, 1] it holds 

qiT,x,Z)=qiT,Z)>\ \ 

This result has been applied in j7| to obtain quantitative recurrence 
results for the maps of the Manneville-Pomeau family. 
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4 Piecewise linear maps 



We now study the behaviour of the Algorithmic Information Content for 
sequences obtained as symbolic representation of orbits of a class of piecewise 
linear maps whose properties are similar to the MP maps. In this case there 
is an isomorphism with a Markov chain with infinite states. We study the 
piecewise linear maps with the following properties. 

Definition 4.1. Let {efcl^gN be a sequence of positive real numbers, strictly 
monotonically decreasing and converging towards zero, with the property 
that 

^^"^ ~ < 1 y keN (17) 
We consider piecewise linear (PL) maps L : [0, 1] [0, 1] defined by 

\l~-el^ (a; - gfc) + gfc-i ek<x<ek-i, k>l 



L{x) 



1-eo 

X = 



eo < X < 1 (18) 



where e_i = 1. Clearly the properties of the maps depend on the sequence 
{efc}, hence varying the sequence we obtain a class of PL maps. 

Using the same approach of Section |21 we consider the partition Z = 
{/q, Ii}, where Iq = [0, eo] and Ii = (eo, 1]- Hence again we have the symbolic 
representation ipz : [0, 1] ^ = {0, 1}*. The general case of an admissible 
partition can be treated similarly as in Section |31 We also use the same 
information function used for the Manneville-Pomeau maps, hence the same 
kind of compression (see equation (jH)) and the definition of s'{ijJ^)), and study 
the information Is'{uj^) = \s'{lj^)\ (see equation Q). 

Again Lemma 13.31 will apply, giving 

Em[AIC{I{Lu"))] ^ E^[/(a;")]^ Em[Nn]logn (19) 

and then to have an upper bound to the information it is sufficient to study 
the behaviour of the random variables A^^ : $7 ^ N. We will see that the 
behaviour of Nn depends from the behaviour of (e^). 

To obtain this we use the theory of infinite Markov chains. Indeed, due 
to their piecewise linearity, these maps are isomorphic to a Markov chain on 
an infinite alphabet, the natural numbers N. The Markov chain is defined 
on the probability space [0, 1] with the Lebesgue measure, and the chain is 
in the state i at time n if and only if L"{x) € (e^-i, ei-2]- 
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The transition matrix will look as follows: 

(en-2 



1 



V ••• 



(eo - ei) 

1 




(ei - e2) 



1 









(20) 



This construction is well-known and we refer to for its definition. 
To study the behaviour of this Markov chain the classical theory of Markov 
chains can be applied giving the results that follows. 

Let to be the "mean recurrence time of the passage through the interval 
/i", in our case 



to 



+00 

E 

k=l 



k (ek-i 



(21) 



The first result is the existence of an invariant measure for the Markov chain 
associated to our dynamical system. 

Theorem 4.2 ( [10] ). There is a measure p invariant for the Markov chain. 
The probability of the event k is defined by p{k) = Ylin=o (en+fc-i — ^n+k-2)- 
This measure is finite if and only if the mean recurrence time to is finite. 

The following result is obtained using the theory of recurrent events 
(dl) of power series (|22J). 



~ i/ instead 



Theorem 4.3. Let to be as above. If to < oo then 'E[Nn\ ~ ^ 
to = CO, then E[A'^„] is an infinite of order less than n. Moreover, let F{x) = 

ESi(efc-i-efc_2). // 

F{x) ~ 1 - Ax"" (22) 

as X ^ oo, where A is a constant and a > 1 then to < oo. 
If F{x) is as above and < a < 1, then to = oo and 



sm an „ 
~ n 



Aair 



(23) 



moreover if b„ 



o{E[Nn\) the set R{n) = {uj / N^ioj) <bn} is such that 

m{R{n)) 0. (24) 



If F{x) ~ 1 - then to = oo and 



E[iVj -logn. 



(25) 
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Proof. The proof of the first statements is based on a characterization of the 
mean E[A'^n]. In it is shown that E[A'„] = [/„, — 1, where [/„ = X]"=q Ui, 
being Uk the probabihty of being in the state "1" at time k. Then, using 
Theorem 1 in [TT|, it follows that 

EK] Un 1 

iim = lim — = lim u„ = — 

n^+oo n n^+oo n n—^+oo to 

Then, if < +oo, that is "1" is ergodic, then EfA^^] is linear on n. Whereas 
if to = +00, that is "1" is a null state, then E[A'^„] = o(n). 

Equations H23|l and ()24() follow from Theorems 10 and 7. 

Equation (|^^ is obtained using the results in p. 242, applications of 
Tauberian theorems, and repeating the argument of Theorem 10 in |11| . □ 

Theorem l4.3l and equation ((TO)) give, as in the previous section, an upper 
estimate of the Algorithmic Information Content of the symbolic orbits of 
our PL maps. 

The final step is to have a lower estimate. This will be done as before, 
by considering an induced map G of equation (|TH) . In this case the level sets 
of the first passage time are exactly the intervals An = (cn-i, In this 

case the G-invariant probability measure on [0, 1] is the Lebesgue measure 
m, hence m{An) = (cn-i — for all n > 1. Since the induced map 

G is now isomorphic to a stochastic process of independent and identically 
distributed random variables with values on S" = {1, 2, 3, . . . }, the AIC of 
sequences in $7 is equivalent to the information function I if and only if the 
entropy of {An}n>i with respect to m is finite, that is if and only if 

H:=-Y, rn{An) log(m(^„)) < 00 (26) 

n>l 

Theorem 4.4. Let L he a PL map on [0, 1] and Z he the finite partition 
{/o,/i}. Then if m denotes the Lehesgue measure and the sequence (e^) 
satisfies equation i2^) it holds 

Em[iVn] ^ Em[AIC{x,n,Z)] ^ E^[Ar„]logn 

Proof. The first inequality follows directly from equation (|19() . If (e^) 
satisfies equation then equation is satisfied. The proof of the 
second inequality now is very similar to the proof of Theorem 13. 8| we only 
have to use equation instead of Theorem 13.21 □ 

We now apply the results of this section to some particular PL maps, 
showing the behaviour of the global chaos indexes and the other features 
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in term of the behaviour of the sequence e^. In the first column we specify 
the behaviour of e^, the related value of to is in the second column, then we 
have respectively the expected value of Nn ih\ 14. 3|) . the entropy H of the 
induced map, the expected behaviour of the AIC of the orbits fbv 14. 4|) . the 
common value of the upper and lower global chaos indexes. The expected 
values and the chaos indexes are with respect to the Lebesgue measure. In 
the last example equation (|2(ij) is not satisfied, nevertheless the result for the 
Algorithmic Information Content follows already from the upper estimate 
of equation (fT!l|) . 



Efc behaviour 




E[iV„] 


H 


E[yl/C(a;")] 


q 


e/c ~ ^ a > 1 


< oo 


n 

— 

to 


< oo 


~ n 


1 


Efc ~ a > 1 


< oo 


n 

~ -0 


< oo 


~ n 


1 


Efc ~ a < 1 


oo 


^ n° 


< oo 


^ ■ ■ ■ ^ log(n) 


a 


1 

^fc ~ log(fc) 


oo 


~ log n 


oo 


^ (logn)^ 






5 Conclusions 

In this paper we considered two classes of weakly chaotic maps of the interval 
with a neutrally unstable fixed point. We calculated the information with 
respect to a partition and showed that this gives an invariant to characterize 
different weakly chaotic dynamics. 

This kind of behaviour for dynamical systems has been largely studied 
in the last years, from many different points of view. The importance of our 
approach lies in the fact that whereas the results given here are theoretical, 
the idea to use compression algorithms to study and measure experimentally 
the kind of chaos in intermittent dynamical systems can be practically ex- 
ploited. In |4,, using a particular compression algorithm that is suitable for 
null entropy strings, we performed experiments on some examples of inter- 
mittent and weakly chaotic dynamical systems and obtained results that are 
close to the theoretical predictions. Moreover, the study of weak chaos by 
compression algorithms gives rise to new questions in data compression (the 
search for algorithms that are optimal compressing zero entropy strings). 

We end remarking that we focused our interest onto maps of the interval. 
A more general approach to define a weak chaos index that is suitable for 
maps on a general metric space X is to use open covers instead of partitions 
(lEjjjH], see also the remarks at the end of section 4 in |lj ). In this paper 
we chose to simplify the question by using admissible partitions, however 
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all the results given here for the partitions hold also for the open covers. In 
jl2j there is some example of results of this kind for PL maps. 
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